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MULTICOLOR STARING SENSOR SYSTEM 

This invention relates to a sensor system, and, more particularly, to a 
sensor system used to detect threats posed by missiles fired at an aircraft. 

BACKGROUND OF THE INVENTION 

5 Missiles fired at aircraft are usually guided either by a light seeker or by 

radar. Of the various types of seekers, infrared light seekers pose some of the 
greatest problems to aircraft defense. Unlike radar seekers, infrared seekers are 
passive and do not emit a detectable signal prior to the firing of the missile. Pilots 
therefore have little warning of their presence prior to the firing of the missile. 

10 Infrared-guided missile systems are relatively inexpensive, and human-portable 
units are widely available. 

There has been a continuing effort to develop sensor systems that are 
carried on aircraft and are used to detect missile threats, particularly infrared- 
guided missiles. The sensor system must be effective to detect the infrared 

1 5 signature of a relatively small-sized missile at as great a distance as possible, in 
order to give the pilot the greatest time to take evasive action or to trigger 
countermeasures. In one approach, a wide-angle, two-color staring sensor system 
has been suggested to be particularly effective in detecting threats. This approach 
uses a two-color "sandwich" detector in the sensor. The technology of such a 

20 two-color detector is complex, still under development, and expected to be 
relatively expensive when finally perfected. Additionally, it is expected to have 
limited resolution, sensitivity, and clutter-rejection capability, particularly when 
mounted on a fast-moving aircraft platform where there is a tendency for digital 
images to be smeared in some viewing orientations. 

25 There is an ongoing need for an improved approach to a sensor system for 

use in an aircraft, particularly for detection of missile threats. The present 
invention fulfills this need, and further provides related advantages. 
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SUMMARY OF THE INVENTION 

The present invention provides a sensor system for sensing the energy of 
a scene, particularly in the infrared range. The sensor system employs a staring 
sensor, so that there are no moving parts that might reduce its reliability. It may 
5 be made in a single-color or multicolor functionality. The sensor system achieves 
excellent resolution while maximizing sensitivity through a short image 
integration time that also reduces smearing of the image. The detector is a single- 
color detector structure, whether the sensor has a single-color or multicolor 
functionality, so that the development, complexity, and cost associated with a two- 

10 color detector are not encountered. The sensor system is packaged in a 
lightweight, small package that is convenient for many applications. 

A sensor system for viewing light energy from a scene comprises a 
detector which converts incident light energy into an electrical signal; an optical 
train that focuses the light energy from the scene; and an optical fiber bundle 

1 5 having an input end that receives the light energy from the optical train and an 
output end that directs the light energy onto the detector. The detector is 
preferably an imaging detector having a detector pixel array. The optical fiber 
bundle comprises a plurality of optical fibers wherein each fiber has an input 
shape and size at its input end and an output shape and size at its output end, and 

20 where the output shape and size are different from the input shape and size. 

In a preferred approach, the light energy from the optical train is mapped 
nonlinearly onto the detector. Desirably, the input shape of each fiber is 
substantially in the form of a rectangle, and the output shape is substantially in the 
form of a square. The fiber input size of each respective optical fiber is preferably 

25 larger than the fiber output size of each respective optical fiber. The sensor 
system also typically includes an electronic device operable to read the electrical 
signal of the detector, and image-processing electronics. Optionally, there is a 
color filter positioned between the scene and the detector. The detector may be 
single-color or multicolor functionality. 

30 The sensor system may use a multiple side-by-side detector configuration, 

each of which detectors is a single-color detector and is thus easier to fabricate 
than a multi-color detector. Such a sensor system comprises a detector, preferably 
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having an imaging detector array, which converts incident light energy into an 
electrical signal. The detector has a first-color region and a second-color region. 
A first-color imaging system comprises a first-color filter positioned between the 
scene and the first color region of the detector, a first-color optical train that 
5 focuses first-color scene energy onto the first-color region of the detector, and a 
first-color optical fiber bundle having a first-color input end that receives the first- 
color scene energy from the first-color optical train and a first-color output end 
that directs the first-color scene energy onto the first-color region of the detector. 
The first-color optical fiber bundle comprises a plurality of first-color optical 

10 fibers wherein each of the first-color optical fibers has a first-color fiber input 
shape and size at its first-color input end and a first-color output shape and size 
at its first-color output end. The first-color output shape and size are different 
from the first-color input shape and size. A second-color imaging system 
comprises a second-color filter positioned between the scene and the second-color 

1 5 region of the detector, a second-color optical train that focuses second-color scene 
energy onto the second-color region of the detector, and a second-color optical 
fiber bundle having a second-color input end that receives the second-color scene 
energy from the second-color optical train and a second-color output end that 
directs the second-color scene energy onto the second-color region of the detector. 

20 The second-color optical fiber bundle comprises a plurality of second-color 
optical fibers wherein each of the second-color optical fibers has a second-color 
fiber input shape and size at its second-color input end and a second-color output 
shape and size at its second-color output end. The second-color output shape and 
size are different from the second-color input shape and size. The additional 

25 and/or preferred features described above for the single-color sensor system may 
be provided with either or both imaging systems of the two-color sensor system. 
Additional color imaging systems may be added if desired. The detector may 
instead be a flat-plane configuration in which the colors are superimposed in a 
"sandwich" geometry. 

30 The present approach thus provides a single-color or multicolor (two or 

more colors) staring sensor system. It may use a single detector, even for 
multicolor sensors, which simplifies the problems of image physical registration 
and time registration. There is good resolution as well as good sensitivity and 
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short integration times. 

Other features and advantages of the present invention will be apparent 
from the following more detailed description of the preferred embodiment, taken 
in conjunction with the accompanying drawings, which illustrate, by way of 
5 example, the principles of the invention. The scope of the invention is not, 
however, limited to this preferred embodiment. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a schematic system diagram of the sensor system; 
Figure 2 is perspective view of an optical fiber in an optical fiber bundle; 
10 Figure 3 is a schematic depiction of nonlinear mapping of the fiber optic 

pixel structure to the detector array pixel structure; and 

Figure 4 is a perspective view of a packaged lens and detector assembly. 

DETAILED DESCRIPTION OF THE INVENTION 

Figure 1 depicts a sensor system 20 for viewing light energy from a scene. 

15 The sensor system 20 includes a detector 22 which converts incident light energy 
into an electrical signal 23. The detector 22 preferably comprises an imaging 
digital focal plane array (FPA) sensitive to a selected wavelength or range of 
wavelengths of interest. The primary interest of the inventors is light in the 
infrared, and the detector 22 is sensitive to light in that range. Imaging detectors 

20 22 operable in the infrared are known in the art. In a common case, the imaging 
detector 22 has a 5 12 x 5 12 detector array of pixels. 

In a preferred embodiment, the detector 22 has a first-color region 24 and 
a second-color region 26. As will be explained in more detail, this preferred 
embodiment is a two-color sensor system 20. The desirability of using two colors 

25 in sensor systems is known in the art, but the present approach provides an 
advantageous way for implementing the two-color approach. The present 
approach is operable with any pair of colors within the range of the detector 22, 
and the selection of the two specific colors to be analyzed is not a part of the 
present invention. If instead the sensor system 20 is a single-color embodiment, 
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the entire detector is devoted to that single color; if the sensor system 20 operates 
with more than two colors, the detector 22 has regions corresponding to the 
number of colors. In most instances, it is not necessary or desirable for the sensor 
system 20 to operate with more than two colors. 
5 The sensor system 20 includes a first-color imaging system 28 comprising 

a first-color filter 30 positioned between the scene and the first-color region 24 of 
the detector 22. A first-color optical train 32 focuses first-color scene energy onto 
a first-color input end 38 of a first-color optical fiber bundle 36 of the first-color 
region 24 of the detector 22. The first-color optical train 32 is formed of lenses 

10 and/or mirrors that achieve the desired focusing of the first-color scene energy. 
Such lenses and/or mirrors are selected according to established optics principles. 
In the illustration, the first-color filter 30 is positioned between the first-color 
optical train 32 and the first-color optical fiber bundle 36, but that need not be the 
case and other operable positioning may be used. 

15 The first-color optical fiber bundle 36 has the first-color input end 38 that 

receives the first-color scene energy from the first-color optical train 32, and a 
first-color output end 40 that directs the first-color scene energy onto the first- 
color region 24 of the detector 22. The first-color optical fiber bundle 36 is 
formed of a plurality of first-color optical fibers 42. 

20 One of the first-color optical fibers 42 is illustrated in Figure 2. (This 

description is applicable to the single type of optical fiber in a single-color sensor 
system and the multiple types of optical fibers in a multi-color sensor system, as 
well.) Each of the first-color optical fibers 42 has a first-color fiber input shape 
and size, numeral 44, at its first-color input end 38a and a first-color fiber output 

25 shape and size, numeral 46, at its first-color output end 40a. The first-color fiber 
output shape and size 46 are different from the first-color fiber input shape and 
size 44. In the embodiment of Figure 2, the first-color fiber input shape 46 is 
substantially rectangular with a ratio of length to width of about 8:1, and the first- 
color fiber output shape 46 is substantially square with a ratio of the sides of about 

30 1:1. The first-color input size is accordingly about 8 times that of the first-color 
output size. The first-color optical fibers 42 are thus tapered from the larger input 
end 38a to the smaller output end 40a. The advantages of this transformation of 
pixel shape as used with a spatial reorientation, such that a typical square pixel 
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detector can be used, as will be explained subsequently. 

The rectangular shaping of the first-color optical fibers 42 achieves 
improved resolution in one dimension to maximize the sensitivity of the sensor 
system 20. Because the potential target (e.g., a missile) in the scene and the 
5 resulting image has a small spatial extent, clutter rejection is achieved by spatially 
filtering objects in the image that are larger than the potential target. Ideally, then, 
the resolution cell is no larger than the maximum potential angular size of the 
potential target. However, small square fiber input shapes, the usual approach in 
pixilated images, would require a larger focal plane array detector than is 

10 achievable at present for a wide field-of-view system. In addition, this resolution 
would be better than the hand-off accuracy that is required. By creating larger 
rectangular collection elements at the input end, the required high spatial 
resolution is achieved with fewer pixel elements than would otherwise be 
required. The angular accuracy of the sensor system 20 is determined by the long 

15 dimension of the input end 38a of the optical fibers, while the resolution for target 
spatial matched filtering is determined by the narrow dimension. In an example, 
assuming a512x512 pixel focal plane array and a 120 degree field of view, the 
accuracy is 1 1.6 mradians (milliradians) and the resolution is 1.45 mradians. 

The tapered fibers also increase the energy collection area significantly 

20 over the area of a conventional focal plane array detector. In the example of 
Figure 2, with an 8 x 1 input end and a 1 x 1 output end, the increased area of a 
factor of 8 in the entrance aperture enables a corresponding decrease in integration 
time. The sensor system 20 is therefore more resistant to blurring of the image 
than a conventional sensor system. 

25 The pixels that are defined by the first-color input end 3 8a of the first-color 

optical fibers 42 are mapped or directed onto selected pixels of the first-color 
region 24 of the detector 22. In conventional mapping practice, the pixels are 
mapped linearly. That is the (n,m) pixel of the scene is necessarily directed to the 
(n,m) pixel of the detector (where n and m are the row and column indices of each 

30 pixel). The present approach is a nonlinear approach wherein the (n,m) pixel of 
the scene is not necessarily directed to the (n,m) pixel of the detector. 

Figure 3 illustrates the preferred mapping approach applied to a specific 
case by way of illustration. This nonlinear mapping approach is selected to allow 
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a standard detector array to be used with rectangular input pixels. In this 
illustration, a 128 x 1024 array of first-color scene energy at the first-color input 
end 38 is mapped onto one-half ofa512x512 detector array (the other half 
receives the second-color image). The (X L ,Y L ) pixel of the first-color scene 
5 energy is mapped to the (X F ,Y F ) pixel of the first-color region 24 of the detector 
22. The first-color image uses all rows of the detector 22 and columns 1-256 in 
this example. The following regions describe the preferred mapping approach: 



X F = X L -(256)(Y F -1) 
Y F -4(Y L -l) + n 

1 0 where 

n=l forX L <256 
n = 2 for257 <X L <512 
n = 3 for 513 < X L < 768 
n = 4 for 769 < X L < 1024 



15 The sensor system 20 further includes a second-color imaging system 48 

comprising a second-color filter 50 positioned between the scene and the second- 
color region 26 of the detector 22. A second-color optical train 52 focuses 
second-color scene energy onto a front face 58 of the second-color fiber optic 
bundle 56 of the second-color region 26 of the detector 22. The second-color 

20 optical train 52 is formed of lenses and/or mirrors that achieve the desired 
focusing of the second-color scene energy. Such lenses and/or mirrors are 
selected according to established optics principles, and are preferably substantially 
identical to the lenses and/or mirrors of the first-color optical train 32. In the 
illustration, the second-color filter 50 is positioned between the second-color 

25 optical train 52 and the second-color fiber optic bundle 56, but that need not be 
the case and other operable positioning may be used. 

The second-color optical fiber bundle 56 has the second-color input end 
58 that receives the second-color scene energy from the second-color optical train 
52, and a second-color output end 60 that directs the second-color scene energy 

30 onto the second-color region 26 of the detector 22. The second-color optical fiber 
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bundle 56 is formed of a plurality of second-color optical fibers 62. 

The second-color optical fibers 62 are preferably tapered in the same 
manner as described for the first-color optical fibers 42. Figure 2 and the 
discussion of Figure 2 are incorporated as to the nature of the second-color optical 
5 fibers 62. 

The second-color scene energy on the second-color optical train 52 is 
mapped nonlinearly onto the second-color region 26 of the detector 22 in the same 
manner as discussed earlier for the first-color scene energy. The prior description 
is incorporated by reference here. 

10 The mapping of the second-color scene energy pixels onto the second- 

color region 26 of the detector 22 follows the approach discussed above, which 
is incorporated here, except that X F is offset by 256 to utilize columns 257 through 
512 of the detector 22. 

The detector 22 converts the incident light energy to electrical signals, 

15 which are processed by its associated electronics 70 to compensate for detector 
irregularities, perform calibration, and perform related functions. The processed 
electrical signals are provided to a computer system that analyzes the electrical 
signals for the presence of a feature, specifically a missile threat. The presence of 
a feature is first determined, numeral 72, by appropriate digital filtering. Any 

20 such feature is then analyzed as to its nature, numeral 74, using established 
criteria. This information is then used to control the detector 22, numeral 76. The 
data on a feature judged to be a threat is provided to other processing electronics, 
not shown, such as a fire control system. Approaches to these elements 70, 72, 74, 
and 76 are known in the art. 

25 Figure 4 illustrates the physical packaging of the non-electronic portions 

of the lens/detector assembly 80 (that is, excluding elements 70, 72, 74, and 76) 
of the sensor system 20, in an application under development by the inventors. 
The lens/detector assembly is housed in a cylinder about 4-1/4 inches in diameter 
and 4-3/4 inches long. There are two viewing apertures 82 and 84, for the first- 

30 color imaging system 28 and the second color imaging system 48, respectively. 

Although a particular embodiment of the invention has been described in 
detail for purposes of illustration, various modifications and enhancements may 
be made without departing from the spirit and scope of the invention. 
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Accordingly, the invention is not to be limited except as by the appended claims. 
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CLAIMS 

What is claimed is: 

1 . A sensor system for viewing light energy from a scene, comprising: 
a detector which converts incident light energy into an electrical signal, the 

detector including an imaging detector array; 

an optical train that focuses the light energy of the scene; and 
5 an optical fiber bundle having an input end that receives the scene from the 

optical train and an output end that directs the energy of the scene onto the 
detector array, the optical fiber bundle comprising a plurality of optical fibers 
wherein each fiber has an input shape and size at its input end and an output shape 
and size at its output end, the output shape and size being different from the input 
10 shape and size. 

2. The sensor system of claim 1, wherein the sensor system further 
includes 

a color filter positioned between the scene and the detector. 

3 . The sensor system of claim 1 , wherein the input shape of each fiber 
is substantially in the form of a rectangle and the output shape is substantially in 
the form of a square. 

4. The sensor system of claim 1, wherein the fiber input size of each 
respective optical fiber is larger than the fiber output size of that optical fiber. 

5. The sensor system of claim 1, wherein the sensor system further 
includes 

an electronic device operable to read the electrical signal of the detector, 

and 

image-processing electronics. 
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6. The sensor system of claim 1, wherein the scene energy from the 
optical train is mapped nonlinearly onto the detector array. 

7. A sensor system for viewing light energy from a scene, comprising: 
an imaging detector which converts incident light energy into an electrical 

signal, the imaging detector having 

a first-color region, and 
5 a second-color region; 

a first-color imaging system comprising: 

a first-color filter positioned between the scene and the first-color 
region of the imaging detector, 

a first-color optical train that focuses first-color scene energy onto 
10 the first-color region of the imaging detector, and 

a first-color optical fiber bundle having a first-color input end that 
receives the first-color scene energy from the first-color optical train and a first- 
color output end that directs the first-color scene energy onto the first-color region 
of the imaging detector, the first-color optical fiber bundle comprising a plurality 
15 of first-color optical fibers wherein each of the first-color optical fibers has a first- 
color fiber input shape and size at its first-color input end and a first-color output 
shape and size at its first-color output end, the first-color output shape and size 
being different from the first-color input shape and size; and 
a second-color imaging system comprising: 
20 a second-color filter positioned between the scene and the second- 

color region of the imaging detector, 

a second-color optical train that focuses second-color scene energy 
onto the second-color region of the imaging detector, and 

a second-color optical fiber bundle having a second-color input end 
25 that receives the second-color scene energy from the second-color optical train 
and a second-color output end that directs the second-color scene energy onto the 
second-color region of the imaging detector, the second-color optical fiber bundle 
comprising a plurality of second-color optical fibers wherein each of the second- 
color optical fibers has a second-color fiber input shape and size at its second- 
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30 color input end and a second-color output shape and size at its second-color output 
end, the second-color output shape and size being different from the second-color 
input shape and size. 

8. The sensor system of claim 7, wherein 

the first-color region of the imaging detector is sensitive to light energy 
that passes through the first-color filter and light energy that passes through the 
second-color filter, and 
5 the second-color region of the imaging detector is sensitive to light energy 

that passes through the first-color filter and light energy that passes through the 
second-color filter. 

9 . The sensor system of claim 7, wherein the first-color region and the 
second-color region are in the same plane. 

10. The sensor system of claim 7 5 wherein each first-color fiber has its 
first-color fiber input shape substantially in the form of a rectangle and its first- 
color fiber output shape is substantially in the form of a square. 

1 1 . The sensor system of claim 7 5 wherein each second-color fiber has 
its second-color fiber input shape substantially in the form of a rectangle and its 
second-color fiber output shape is substantially in the form of a square. 

12. The sensor system of claim 7, wherein the first-color fiber input 
size of the first-color optical fibers is larger than the first-color fiber output size 
of the first-color optical fibers. 

13. The sensor system of claim 7, wherein the second-color fiber input 
size of the second-color optical fibers is larger than the second-color fiber output 
size of the second-color optical fibers. 

14. The sensor system of claim 7, wherein the sensor system further 
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includes 

an electronic device operable to read the electrical signal of the imaging 
detector, and 
5 image-processing electronics. 

15. The sensor system of claim 7, wherein the first-color scene energy 
from the first-color optical train is mapped nonlinearly onto the first-color region 
of the imaging detector. 

16. A sensor system for viewing scene energy, comprising: 

an imaging detector which converts incident light energy into an electrical 
signal, the imaging detector having a first-color region and a second-color region; 
a first-color imaging system comprising: 
5 a first-color filter positioned between the scene and the first-color 

region of the imaging detector; 

a first-color optical train that focuses first-color scene energy onto 
the first-color region of the imaging detector, and 

a first-color optical fiber bundle having a first-color input end that 
10 receives the first-color scene energy from the optical train and a first-color output 
end that directs the first-color scene energy onto the first-color region of the 
imaging detector, wherein the first-color scene energy is mapped nonlinearly onto 
the first-color region of the imaging detector, the first-color optical fiber bundle 
comprising a plurality of first-color optical fibers wherein each of the first-color 
15 optical fibers has a first-color fiber input shape and size at its first-color input end 
and a first-color output shape and size at its first-color output end, the first-color 
output shape and size being different from the first-color input shape and size; 
a second-color imaging system comprising: 

a second-color filter positioned between the scene and the second- 
20 color region of the imaging detector; 

a second-color optical train that focuses second-color scene energy 
onto the second-color region of the imaging detector, and 

a second-color optical fiber bundle having a second-color input end 
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that receives the second-color scene energy from the optical train and a second- 
25 color output end that directs the second-color scene energy onto the imaging 
detector, wherein the second-color scene energy is mapped nonlinearly onto the 
second-color region of the imaging detector, the second-color optical fiber bundle 
comprising a plurality of second-color optical fibers wherein each of the second- 
color optical fibers has a second-color fiber input shape and size at its second- 
30 color input end and a second-color output shape and size at its second-color output 
end, the second-color output shape and size being different from the second-color 
input shape and size; 

an electronic device operable to read the electrical signal of the imaging 
detector; and 
35 image-processing electronics. 
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MULTICOLOR STARING SENSOR SYSTEM 

ABSTRACT OF THE DISCLOSURE 

A sensor system for viewing the light energy of a scene has an imaging 
detector which converts incident light energy into an electrical signal. Two colors 

5 are separately imaged by the detector in two imaging regions. The imaging 
system for each color includes a color filter positioned between the scene and the 
respective region of the detector, an optical train that focuses filtered color scene 
energy, and an optical fiber bundle having an input end that receives the 
respective color scene energy from the optical train and an output end that directs 

1 0 the color scene energy onto the respective region of the detector using a nonlinear 
mapping. The optical fiber bundle is formed of a plurality of optical fibers 
wherein each of the optical fibers has an input shape and size at its input end and 
an output shape and size at its output end. The output shape and size are different 
from the input shape and size. The sensor system further includes an electronic 

1 5 device operable to read the electrical signal of the detector, and image-processing 
electronics. 
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patentability as defined in Title 37, Code of Federal Regulations, §1.56. 
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□ Yes □ No 

Number Country Day/Month/Y ear Filed 

I hereby claim the benefit under Title 35, United States Code, § 120 of any United States application(s) listed below and, insofar as the 
subject matter of each of the claims of this application is not disclosed in the prior United States application in the manner provided 
by the first paragraph of Title 35, United States Code §112, I acknowledge the duty to disclose to the United States Patent and 
Trademark Office all information known to me to be material to patentability as defined in Title 37, Code of Federal Regulations, 
§ 1.56 which became available between the filing date of the prior application and the national or PCT international filing date of this 
application: 
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William C. Schubert Registration No. 30,102 

Glenn H. Lenzen, Jr. Registration No. 29,320 

Leonard A. Alkov Registration No. 30,02 1 

Colin M. Raufer Registration No. 40,78 1 

Address all correspondence to Patent Docket Administration, Raytheon Company, Bldg. EO/E01 M/S El 50, P.O. Box 902, 
El Segundo, California 90245-0902. Address all telephone calls to W i 1 1 i a m C. Schubert, 805-562-2108. 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information 
and belief are believed to be true; and further that these statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the Umted 
States Code and that such false statements may jeopardize the validity of the application or any patent issued thereon. 
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